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ABSTRACT 


Experimental measurements of pilot scanning and control response 
in a simulated instrument approach are reported. Seven subjects flew 
Category II-like ILS approaches in a six degree of freedom fixed-base 
De-8 simulator at the NASA Ames Research Center. A conventional instru- 
ment panel and controls were used, with simulated vertical gust and 
glide slope beam bend forcing functions. Pilot eye fixations and scan 
traffic on the panel were measured using a recently developed eye point- 
of-regard (EPR) system. The EPR data were reduced for 31 approaches with 
@ cross section of subjects to obtain dwell times, look rates, scan rates, 
and fractional scanning workload. These data are compared with previous 
experimental results. Simultaneous recordings were made of displayed 
signals, pilot response, and vehicle motions to permit their correlation 
with the eye movement results during the next phase of the overall program. 


Flight director (zero reader) and standard localizer glide slope 
(manual) types of approaches were made. Both fixed and variable instru- 
ment range sensitivities were included. The scanning results showed the 
attitude and glide slope/localizer instruments to be primary in a manual 
ILS approach, sharing 70 to 80 percent of the pilot's attention. The 
glide slope/localizer instrument required shorter dwell times with a 
fixed instrument sensitivity. Differences in dwell time between pilots 
only occurred on the attitude instrument. With the flight director, 
glide path deviation errors were reduced and the flight director instru- 
ment dominated pilot attention (about 80 percent). There were no apparent 
circulatory scanning patterns in any of the approaches. These EPR results 
were generally consistent with prior data where meaningful comparisons 
could be made. 


This report summarizes experimental research accomplished as one 
part of an overall program aimed at developing models and methods for 
the analysis and synthesis of manual control displays. It presents the 
results of the first phase of a two phase effort to measure and corre- 
late pilot eye movements and control actions during instrument approach. 
The research was conducted for the Man-Machine Integration Branch of the 
NASA Ames Research Center under Contract NAS2-4746. The NASA project 
monitors were M. K. Sadoff and W. E. Chase. The STI Technical Director 
was D. T. McRuer. The project engineer for this part of the program 
was D. H. Weir. 


Particular credit is due H. R. Jex, whose key role in the development 
of the eye point-of-regard system made the experiments possible. The con- 
bined efforts of H. R. Jex and G. L. Teper in evolving the program plan, 
as well as the assistance of R. EH. Magdaleno and R. W. Allen in the early 
stages of the program is particularly acknowledged. The authors are deeply 
indebted to the seven pilot subjects for their interest, cooperation, and 
dedication; without which the program could not have been accomplished. 
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SECTION I 
INTRODUCTION 


A. OBJECTIVES 


ther development and validation of the theory of manual control 
displays (Ref. 1) required simultaneous eye movement and pilot response 
data in flight control tasks under realistic instrument conditions. The 
primary objective of this research program was to obtain such data for 
instrument approach tasks. A second objective was to reduce the eye 
point-of-regard data to the scanning statistics needed to continue the 
development of methods for analysis and synthesis of manual control dis- 
plays. These objectives have been accomplished, and data are now in 
hand for several airline pilots in more than a hundred simulated instru- 
ment approaches in a subsonic jet transport. Detailed scanning statistics 
have been computed for a eross section of thirty-one 2 minute runs. These 
results are part of the data base for the next objective-— correlation of 


eye point-of-regard with control response and displayed motion variables. 


B. BACKGROUND 


The first definitive experimental research in this area was accomplished 


by Milton, Jones, and Fitts in a herculean 8-year experiment. They used an 


eye camera to measure the instrument scanning patterns of pilots in a variety 


of actual IFR maneuvers (Refs. 2, 3, 4, 5, and 6), but no records were 


made of the concomitant instrument readings or pilot responses. Very stable 


statistical traffic patterns appeared in their results for various pilots 
and maneuvers. A reexamination of this work with an attempt at supplying 
the missing signal properties by pilot vehicle analysis (Ref. 7) was 


indicative but inherently inconclusive. 


Other workers who have measured instrument scanning behavior have been 


concerned mostly with the statistical models of the scanning process, rather 


than with the establishment of connections with the causal factors of the 
displayed signals themselves (e.g., Refs. 8, 9, and 10). Again, the dis- 
played signals were either not recorded or not correlated against the 


scanning behavior. 


A theory for manual control displays is presented in Ref. 1. It 
combines servo analysis techniques, multiloop pilot response models, 
and a scanning and sampling perceptual theory (updated in Ref. 11) to 
obtain a procedure useful in prediction and display design. The pro- 
cedure is applied in Ref. 1 to a piloted jet-transport Instrument 
Landing System (ILS) landing approach as an analytical example. No 
experimental data were available to validate the predicted pilot 


response and scanning traffic. 


The first effort to measure and correlate the visual sampling process 
and pilot control is reported in Ref. 12. It was aimed primarily at 
validating a queing theory for display scanning. Although detailed, the 
Ref. 12 results are not complete enough to validate the overall theory 
and methods of Refs. 1 and 11. Specific shortcomings from our viewpoint 
include lack of a contemporary panel layout, no forcing functions (useful 
in measuring pilot response), and inadequate definition of the controlled 


element dynamics. 


In these past studies the data-taking process has used eye movement 
cameras, electro-oculographics, or corneal reflection techniques. These 
tend to be expensive, difficult to operate, and detrimental to the experi- 
mental environment. A recently developed eye point of regard (EPR) system 
provides simple, inexpensive direct readout of the coordinates of eye fixa~ 
tions on the instrument panel. This, coupled with proven experimental 
techniques for measuring pilot dynamic response in multiloop tasks (Refs. 13 
and 14), and the availability of a high fidelity simulation facility at NASA 
Ames Research Center, gives the tools to perform the needed behavioral 


measurement program. 
C. PREVIEW OF THE REPORT 


This study used a NASA Ames Resedreh Center, fixed-base six degree of 
freedom simulator, configured as a DC-8. Current comercial airline pilot 
subjeets flew landing approach tasks. Pertinent displayed variables, eye 


fixations, pilot response, and vehicle motions were measured. 


Section IT describes the experiments. This includes a detailed descrip- 


tion of the equipment, controlled element (simulator) properties, system 


forcing functions and signal recording. The qualifications of pilot 


subjects, experimental procedures, tasks, and instructions are detailed. 


Section III presents the eye scanning data and statistics for 31 
selected runs. Both manual TIS and flight director results are given. 
Dwell times, scan rates, display workloads and link values between 
instruments are derived. Tests of significance are used to differen- 
tiate the data and provide a basis for lumping like results. Previous 
eye fixation data are presented where applicable, to place the present 
results in context and to highlight differences. Finally, additional 
features of the EPR data such as blinks, transitions, and looks within 


instruments are described. 


The final section summarizes the results and conclusions. 


SECTION II 
DESCRIPTION OF THE EXPERIMENTS 


The experiments involved pilot control in a conventional Category II- 
like* instrument approach im a six degree of freedom fixed-base simulation 
of a DC-8 aircraft. The panel layout was typical of a subsonic jet trans- 
port, with some configurations employing a flight director (FD). The 
subjects were airline pilots and copilots. The task was to fly an IIS 
(Instrument Landing System) approach from the outer marker (30,000 ft 
from threshold) to the middle marker in the presence of vertical gusts, 
6a, and glide slope beam bends, EGS," Aircraft motions, displayed signals, 
pilot response, and eye point of regard were tape recorded. The system 
block diagram is shown in Fig. 1. Details of the experimental setup and 
procedures are given in this section and its appendices. The experiments 


were performed at the NASA Ames Research Center. 


A. EXPERIMENTAL SETUP 


The experimental configurations are described in Table I. Configura- 
tion A was a pitch attitude tracking task designed to provide single-Loop 
response data on the present subjects for correlation with past data and 
models. Configurations B, C, and D involved a "raw presentation" of ‘ 
localizer and glide slope deviation, pitch and roll attitude, and periph- 
eral instruments, but no flight director display. These tasks varied 
in their detail in order to explore effécts of scanning and statistical 
stationarity. Configurations E and F employed all the displays of C 
and D, respectively, plus a lateral and longitudinal flight director 
display superimposed on the artificial horizon. The visual breakout 
runs were peripheral to the main experimental program. The "fixed 


range" configurations had the instrument range varying sensitivities 


*The approach was like Category IIB, because it involved at least 
1,200 £t RVR and 100 ft decision altitude minimums. It differed from 
usual Category II procedures because the pilots were asked to fly it 
on basic ILS needles (with no flight director) in some cases. 
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Figure 1. Block Diagram of Experimental Task 


Single axis tracking task with pitch 
attitude display and forcing function. 
Other instruments masked. Other axes 


controlled by autopilot. No flight 
director. 


Three degree of freedom longitudinal 
task. Forcing functions and tracers 
on, Lateral axes under entopilot 
control, but meters visible. Mo 
flight director. 


All axis approach task with forcing 
fanctions and tracers on. ‘The glide 
slope deviation computer range was 
fixed at 30,000 ft from threshold, 
‘The altimeter and rate of climb meters 
appeared normal (varying range). Ho 
flight director. 


ALL axis approach task with forcing 
functions and tracers on. The range 
varied throughout the run. Glide 
slope deviation per nit altitude 
error increases with decreasing range. 
No flight director. 


All axis approach task with forcing 
functions and tracerz on. Flight 

director on, and driven by forcing 
function, Same as Configuration C 
plus flight director. 


All axis approach task with forcing 
functions and tracers. Flight director 


ou. Glide slope component cf FD 
forcing function attenuated with 
range by flight director computer. 
Same as BE, except range varying. 


All axis approech task with Configu- 
rations D or ¥, except that the Grs 
system vas used to provide an extern. 
visual field display at 200 ft above 
ground. Pilot looked up when told by 
oopllot/experimenter. Breakout 
occurred some time after the 100 sec 
rum. 


Tie in with single loop tracking data. 


Provide longitudinal scenning task, 
and basis for validating miltiloop 
pilot response nodel. 


Provides stationary al) axis task. 


Reference case for comparism with split 
axig, range varying, and flight director 


cases. 


Provides nonstationary longitudinal 
task. Typical of "old fashioned” 
cross pointer I18 display. 


Provides equalized, integrated display 
and stationary all axis tesk. Refer- 
ence flight director case. Typical 
of modern practice. 


Exploratory investigation of the 
feasibility of measuring both visual 
field ani panel EPR. Used with only 


a few runs at the end of the experimental 


program. 


Similates a portion of the approach 

task, Control pitch attitude only, and try 
to keep pitch error equal to sero. There is 
some turbulence. ‘The lateral autopilot is 
ON. 


Simlates e split-axcis manual approach under 
Category II conditions. Control oly the 
longitudinel motions. An extopilot is con- 
trolling the isteral motions. ‘There is some 
turbulence. Try to keep the glide slope needle 
centered at all times. 


Simulates a Category I manual ItS approach. There 
is some turbulence. Try to keep the glide slope and 
localizer needles centered at all tines. 


Simulates « Category II FD approach. There is some 
turbulence. Use the Director to follow the approach 
path, keeping the glide slope and localiser needles 
centered. Pitch commends must be obeyed immediately 
to avoid e atendoff, ‘The glide slope ani localizer 
needles must be monitored, 


Some as D or F, except that copilot calls out altitude 
and says “runway in sight” vhen visual eoqrisition 
occurs. 


fixed at the values existing near the outer marker, 30,000 ft range from 
threshold. Specific differences between the configurations arise in 
controlled element dynamics, displayed signals, and forcing function 


properties; and these are detailed subsequently, 


1. Apparatus 


The experimental apparatus was located at the NASA Ames Research Center. 


It is described in Appendix A, and consisted of: 


analog computers 

recording equipment (FM tape and strip chart) 
taped forcing functions . 
instruments and their drive mechanisms 
cockpit, panel, and control colum 


eye point of regard (EPR) measuring system 


interconnections 


The computers and recording equipment were in a building separate from 
the cockpit containing the subject, experimenter, and EPR system as 
shown in Fig. 2. The allocation of functions was conventional, with 
the vehicle dynamics, control equations, and scaling done on the analog 
computers; recording of EPR, vehicle motions, displayed signals, pilot 


response, etc., was done on an FM tape and strip chart recorder. 
2. Controlled Element 


Properties of the various controlled elements and the panel layout 
are detailed in Appendix B. The simulated vehicle was nominally a sub- 
sonic jet transport in the landing approach configuration. The dynamics 
were defined by a linearized set of perturbation equations in six degrees 
of freedom. The simulator was stabilized with full flaps and gear down 
at 1355 kts on the approach path at the outer marker at the start of the 
run. The speed was nominally that of the United Airlines DC-8 for 
turbulence conditions as recommended by the Flight Manual (Ref. 15). 

No changes in flaps, trim, or power setting were required during the 
run— although the pilot was free to make throttle corrections. The 
vehicle transfer functions and sample transient responses are given 


in Appendix B. 
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SIMULATOR BUILDING 


Figure 2. Topological Layout of Equipment 


The panel layout for the manual ILS configurations is shown in 


Fig. 3. The instrument needles have been deleted for clarity. ‘The 
flight director bar appeared on instrument 2 for Configurations E 
and F. 


The flight director provided pitch and roll commands. The equations 
are given in Appendix B. The longitudinal director mixed pitch attitude 
and altitude errors. The latter were computed from the angular glide 
slope deviation by multiplying by the range to the glide slope trans- 
mitter. This caused the forcing function amplitude (component due to 
the glide slope command) to decrease during Configuration F runs. The 
lateral director mixed roll angle, heading angle, and (angular) localizer 


deviation errors. 


A low gain “autopilot" was used in Configuration B to simulate human 


pilot control of the lateral axes. It is described in Appendix B. 


The panel instrument dynamics are part of the controlled element and 
their properties are shown in Appendix B. The attitude ball, glide slope 
bar, localizer bar, and pitch and roll director display frequency responses 
all looked like well damped second-order systems with break frequencies in 


the region 1 to 1.5 Hz. The peripheral instruments were more responsive, 


Properties of the elevator, aileron, and rudder manipulator were 
measured, and these are shown in Appendix B. The column and wheel operated 
a hydraulic feel system. The DC-8 pilots termed it a reasonable facsimile 
of that aircraft, the Boeing 707 pilots felt it was somewhat light and 


sensitive, and the Convair 990 pilot thought it too sluggish and insensitive. 
3. Forcing Functions and Tracers 


Two independent longitudinal forcing functions, a pitch attitude 
command, 6,4, and a glide slope deviation command, €qgg» were used in 
the experiments. This permits multiloop describing functions to be 
computed from the data. Tracers, consisting of one or two Low amplitude 
sine waves, were added to'’some displayed signals. The forcing functions 


and tracers are detailed in Appendix C and summarized below. 


° 
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NUMBER ° 


(5, HSI/GSD) 


Figure 3. Layout of Basic Flight Instruments 


The pitch attitude command similated a vertical gust input. It 
was a stationary random-appearing signal composed of a sum of sine 
waves. It had a bandwidth of 0.8 rad/sec and an rms amplitude of 
1.2 deg. Lower amplitude higher frequency components comprised a 
"shelf" to facilitate response measurements in the region of the 
@-lLoop pilot crossover frequency (see Fig. C-3 in Appendix C). The 
pitch command was roughly equivalent to a 5 ft/sec rms vertical gust 
acting on the closed-loop pilot/vehicle system. The subject pilots 
felt in general that it represented fairly large (but not unrealistic) 
turbulence for landing approach. Pilot 3 had only encountered that 
turbulence level once (during landing) in thunderstorm conditions, and 
another pilot said he would not try to land in those conditims. Sub- 
jects were instructed that they had no choice but to make the approach, 


The glide slope command forcing function simulated low frequency beam 
bends. It was a random-appearing sum of sine waves with an effective 
bandwidth of about 0.3 rad/sec and a mid-frequency low amplitude shelf. 

Tt had an rms amplitude of 0.04 deg path angle or about 0.2 dots of 

needle deflection. This input magnitude was around the upper limit 

of acceptability for Category II beam bends, and occasionally exceeded. 

it. The limit is 30 pA decreasing to 20 pA at the middle marker (Ref. 16), 
which corresponds to about 0.3 dots. The glide slope command always 
entered the simulation as an angular deviation. This gave a statistically 
stationary forcing function on instrument 5 (glide slope deviation) for 
all configurations.* The glide slope command component of the flight 
director pitch command was nonstationary in Configuration F, decreasing 
with range; because of the altitude computation in the flight director 


computer. 


The two command inputs were independent, containing different component 
sine waves which were “interleaved,” as shown in Appendix C. The presence 


of two independent inputs occasionally troubled some subjects because they 


*Note that the displayed glide slope deviation per unit altitude dis- 
placement was nonstationary in the range varying configurations (D and F), 
requiring the pilot to reduce his altitude loop gain as the approach 
progressed. 


could be pitching up while the glide slope deviation indicated they were 
descending. This and other glide slope deviations were interpreted as 
large vertical shears even though they were due to beam bends. Subjects 
commented that the airspeed was unusually stable, and that they would 
expect it to vary more in that level of turbulence. The displayed rate 
of climb excursions were sometimes quite large (for approach conditions, 
particularly) due to pilot efforts to perform the task. The pitch and 
glide slope commands were fed into the flight director computer for 
Configurations E and F, and some of the subjects said that the resulting 
pitch bar excursions (closed-loop with the inputs) were larger than they 


were used to (on different directors). 
Tracer frequencies were added to the following displayed motions: 
Localizer deviation 


Roll angle 
Rate of climb 


Forward velocity 


The details are given in Table C-I, Appendix C. They consisted of 
sinusoids with amplitudes just above threshold on the non-driven meter. 
They were designed to detect pilot response to these meters through 
examination of elevator and aileron spectra for peaks at the tracer 
frequencies. Their use was exploratory, although the potential feasi- 
bility had been demonstrated in prior laboratory studies using two 


displays. 
4. Signals Recorded 


The displayed signals, pilot response, vehicle motions, and eye 
movements were recorded during the runs. The specific quantities 


recorded on 14 channel FM-tape included: 


Vertical coordinate of eye point of regard, EPRy 
Horizontal coordinate of eye point of regard, EPRy 
Pitch attitude command, 6, 

Glide slope command, <6S, 


Pitch attitude error, Q., 
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Glide slope deviation error, EGSe 


Elevator deflection, 5, 

Roll angle, 

Localizer deviation, eto¢ 

Aileron deflection, 3, 

Rate of climb, h 

Heading angle, y 

Voice commentary and identification 


4O Hz digitizing tone 


During flight director runs (Configurations E and F) the pitch and roll 
director commands were recorded in lieu of rate of climb and heading 


angle. 


Two 8 channel strip chart recorders were used to record all but the 


voice channel, plus: 


Flight director pitch command, FD, 


Airspeed, U, or flight director roll command, FD, 


Mean-square localizer deviation, eric 


Mean-square glide slope deviation, ee 


The latter two were duplexed on one channel. 
B, PILOT SUBJECTS 


Seven pilot subjects participated in the program, and data for four 
of them are considered in this_report. Their flight experience and panel 
arrangements of aircraft they currently fly are summarized in Appendix D. 
Pilots 1, 2, and 4 had prior experience on this particular simulator in 
other research programs, but under slightly different instrument arrange- 
ments and test conditions. Pilot 4} was used in the shakedown runs asso-~ 
ciated with setting up and validating the simulation. Pilot 3 was 
unfamiliar with this simulator but had participated in previous STI 
experiments at other facilities. The subjects were all current pro- 
fessional airline pilots or copilots. The simulation was sufficiently 
similar to their current experience that the pilots were able to achieve 


a stable level of proficiency within a few runs. 


i) 


All the pilots were volunteers who had an interest in the program 
and its eventual outcome. They were paid a modest hourly rate. Their 


selection was based on the following factors: 


Interest, motivation, and availability 
Experience and current flight assignment 


Acceptance of the simulation 


Quality of EPR data (minimum saccade artifacts, 
eyelid lag, drift, etc.) 


No need for corrective glasses, since it inter- 
feres with the eye movement device. 


These qualities were also considered in selecting the data for detailed 
analysis. Pilot 4 normally wore glasses, but he did not require them 


for instrument flight (panel scanning). 


The pilots reflect a cross section of age and background. Pilot 1 
is a senior instructor captain with multiengine piston and jet bomber 
experience. Pilot 2, a younger copilot, transitioned to commercial 
flying via the general aviation/light aircraft route. Pilot 3, although 
a copilot, has extensive military single engine fighter/bomber experience, 
and Pilot 4 is a multiengine test pilot of long standing. 


C. EXPERIMENTAL PROCEDURE 


subjects, familiarization, and the steps used during experimental sessions. 


These are summarized below. 
1. Instructions to Pilot Subjects 


Prior to any simulator flying, each of the pilot subjects was given 
an overall briefing on the program and its research goals. The following 


points were covered in this briefing: 


@® Simulated airplane is a DC-8 


@ The task involves a Category II-like approach 
using conventional instruments with no visual 
runway acquisition, flare, or landing. There 
will be no surprises or unexpected emergencies. 
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A set of sensors mounted on eyeglass frames will 
be used to monitor eye scanning. 


Pitch attitude and glide slope deviation inputs 
are used to make the task difficult. It will 
look like severe turbulence and it may seem a 
little artificial, but try and fly it as you 
would an actual approach. 


This study is considering “limiting cases" which 
are the ones which govern designs. Assume that you 
have to make this approach and that you can't abort. 
The only alternative is to bail out or crash land. 


This was followed by an informal discussion of the simulation layout 


and general procedures. 


After becoming settled in the left seat in the simulator the pilots 
were given general instructions regarding the initial conditions and 


cockpit procedures. These instructions were: 


"The task is to fly the approach from outside the 
outer marker to inside the middle marker. You will 
begin stabilized on the 3 deg glide slope. Beam 
acquisition is not required. The 'bug speed' is 


135 kts. Both gear and flaps are down and all check- 


Are there any questions?” 


lists are completed. The initial altitude is 2,000 ft 
and the field elevation is 5312 ft. The problem will 
end pricr to runway visual range and there is no need 
to flare or look for the runway. The experimenter will 
announce the end of the run. Try to keep the glide slope 
and localizer needles centered at all times. 


Due to the simulation setup and limitations we would 


like you to try to follow these additional conditions: 


Retrim pitch attitude ball at start of run. 
Don't use the trim button or trim wheels. 
Full flap all the way down 


There should be no need for throttle movements 
(it's initially trimmed). 
After run, take hands off wheel and throttle. 


Try not to clamp jaw, squint, or move ears. 
Even if very difficult—try to stay with it. 


Don't say anything during the run. 


After the run, describe any control problems 
or difficulties. 


These general instructions were not given to the pilot more than 
once ar twice, but the appropriate instructions in the right hand 
column of Table I were given to the pilot prior to. each individual 
run. The need to try to keep the glide slope and localizer needies 


centered at all times was reemphasized continuously. 


A few runs were made on the last two days of the exper iments which 
involved visual breakout and required the pilot to acquire the runway, 
flare, and land. These were purely exploratory and followed the main 
experimental program (so as not to influence the latter). Revised 
instructions and procedures were used for these runs, including the 
experimenter/copilot calling "runway in sight." These are described 


more fully in subsection 3, below. 
2. Run Sequence 


Each pilot was given several initial familiarization runs of both 
manual ILS and flight director tasks without input forcing functions. 
This enabled the pilots to evaluate the aircraft's flying characteristics, 
become familiar with new instrumentation, and experience the cockpit pro- 
cedures. Familiarization runs were only performed during the pilot's 


first training session (1 or 2 hours) and were not tape recorded. 


Practice runs (involving 1 or 2 sessions) followed the familiarization 
and enabled the pilots to experience the input forcing functions as applied 
to the three basic configurations (B, C, and E). Frozen range tasks were 
used in practice because: they could be of any run length; they allowed 
stationary pilot behavior; and they were to comprise the buik of the 
final data runs. During the practice runs the EPR system was explained 
and the equipment fitted to the subject. All practice runs were tape 


recorded. 


All formal record runs (after the familiarization and practice 
sessions) included 2 or 3. "warm-up" runs with the basic configurations, 
usually 1 of each without the EPR system. The final data runs were 


made with the EPR system. A data session usually involved 5 or 6 
100 sec runs in succession, divided at random between manual ILS and 


flight director configurations. Fixed range and varying range 
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configurations were not mixed in the same session, but were run on 


separate days. 
3. Procedure 


A session began with warm up runs, followed by installation of the 
EPR system. Two experimenters were required to make the runs. While 
one was in the simulator cab trimming the EPR system and instructing 
the pilot on the task, the other rewound the input forcing function tape, 
set the mechanization for the next task, and updated the run log. 


When the pilot was ready the FM tape recorder was started and an 
EPR calibration made. This consists of looking at each instrument in 
sequence. This calibration record was made before and after each run 
so that even a nonlinear eye angle transducer adjustment could be later 
reduced off-line to the actual instrument regarded. Immediately after 
calibration the forcing function tape was started and the simulation 
was placed in operation. The pilot began performing the task as soon 
as he saw the forcing functions appear. The digitizing tone, signifying 
the start of the 100 sec run was turned on about 10 sec after the start 
of the run. After approximately 2 min of running the experimenter would 
call “run completed," at which time the simulator would be reset and 
another EPR calibration made. The digitizing tone was turned off 10 


or 15 sec before the end of the rum. 


All communication channels were common, and any conversation taking 
place during the run was recorded on the FM data tapes. Pilot comments 
were also recorded on a hand held tape recorder for a standard series 


of questions and as much pilot/experimeter interchange as possible. 


Rest periods of 15-20 min for every 5 runs (about 30 min of data 
taking) were required. Normal data taking sessions were 2 to 2.5 hr 


duration, including EPR setup, with only one session per day per pilot. 


For the visual breakout rums a "copilot" performed any additional 
cockpit procedures desired by the pilot. This included such things as 
100 ft altitude increments when below 500 ft, speed below bug, excessive 


rates of descent, etc., depending on individual pilot preference. ‘The 
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forcing functions were gradually turned to zero inside the middle marker. 
The EPR system was reset to provide an indication of when the pilot Looked 


te 


up at the "real world” display. 


D. SHAKEDOWN RUNS 


A short preliminary series of experiments was accomplished near the 
outset of the project to shakedown and validate the simulation. This 
involved (to the extent possible) all of the apparatus, inputs, configura~ 
tions, procedures, etc., to be used in the formal data runs. Pilot } was 
the main subject, although several other engineer/pilots flew the simulation 


for evaluation purposes. 


The specific objectives of the shakedown runs were to check out and 


validate: 


@ The forcing function amplitudes and bandwidths 


@ The EPR system operation, data quality, and EPR 
data reduction procedures 


® Pilot response measures, data quality, and data 
reduction procedures 


@ The overall simulation for fidelity, realism, and 
pilot acceptability 


@® Session schedules, timing, check lists, and 
detailed sequence of procedures 
Several changes were made as a result, although the overall validity was 


confirmed. 


Important changes were made in the pitch attitude and glide slope 
foreing functions. The original effective input bandwidths were 1.0 and 
0.5 rad/sec, respectively. The high frequency shelf was only 14 dB down 
from the amplitude of the low frequency sine wave components. These 
effects combined to produce a lot of high frequency content in all the 
longitudinal displays. The pilot had some difficulty trying to fly it 
and he felt that it was unrealistic and "jumped wp and down" too much. 
As a result the bandwidths and shelf amplitude were reduced to the 
levels shown in Appendix C. The amplitude was rescaled upward to 
preserve about the same rms level. The revised inputs were subsequently 
judged to be acceptable, although of fairly large amplitude for an 
approach task. 
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The altimeter, rate of climb meter, and pitch attitude ball were not 
biased (to simulate descent) for the fixed-range configurations during 
the shakedown. This detracted from the realism of the simulation and 
tended to distract the pilot. The necessary changes were made to make 
the panel appear as if range were decreasing along the nominal 3 deg 


glide slope. 


Pilot operation of peripheral controls occurred during the shakedown 
runs. This was judged to be bad as it tended to increase his workload 
(probably unnecessarily) and to bias the pilot/vehicle dynamic response 
in an undesirable way. Several remedial steps were taken. The rudder 
pedals were electrically disconnected from the simulation, so the pilot 
could still "coordinate" aileron motions without introducing additional 
remnant in the lateral axis (which had no forcing function in the first 
place!). The pilot was requested not to use the electric trim buttons 
(on the wheel) during the run, but to use elevator instead. The pilots 
were told that throttle corrections weren't required (it was initially 
trimmed), but that they could use throttle if the airspeed got too far 
off. This reduced throttle activity quite a bit, resulting typically 


in only one or two minor corrections per run. 
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SECTION IIT 
EYE POINT OF REGARD DATA 


Detailed eye scanning data and statistics comprise a primary result 
of this part of the program. The other major result was simultaneous 
recordings of control response and displayed variables, suitable for 
correlation with these eye movement data. Eye point of regard (EPR) data 
for 31 runs involving 3 subjects and 5 configurations have been analyzed 
in detail. The results include dwell properties, scanning workload, and 
link values. They show little difference between similar configurations 
for the same pilot, major differences between dissimilar configurations 
(with and without the flight director), and some significant differences 
between pilots in similar tasks. The results, data reduction details, 


and comparisons with past work are given in this section. 
A. DEFINITIONS AND REDUCTION FROCEDURE 


A standard set of calculations and reduction procedures were defined 
in advance so that the data would be consistent. The raw vertical and 
horizontal eye traffic was picked off manually* and reduced to punch 
cards. The scanning traffic and statistics were obtained with a 


Fortran IV program on a time sharing computer. 


Some definitions of the properties of the raw and reduced EPR data 


are needed, For a given run of Tp sec duration: 


M is the number of instruments 

Ns is the number of fixations on instrument 1 

Ny is the total number of fixations on all instruments 

N is the total nunber of fixations on instruments, 
elsewhere, blinks, etc. 


It follows that 


M 
Ny =- Do Ny 
i=l 


*Manual reduction was most expeditious for the amount of data 
analyzed in this study. The raw analog EPR data are intended to be 
digitized and entered directly into the computer with no manual steps, 
but there was no provision for program development as part of this project. 
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The duration of a look at a given instrument is called the dwell time, 
Ug. 9 and 


Tdi, is the duration of the kth dwell on instrument i 


Ny 
T; = > Tas. is the total time fixating i 
kK=1 
M 
hes eT e Tomas 
i=] 


where nay includes blinks and looks elsewhere than at the defined 
instruments. 


For data reduction convenience we assign a number to 


blinks and other regions of the panel so that all time during the run 
is subscripted and allocated. 


Average properties of the data are important. 


The mean dwell 
time on instrument i is 


bit 
He. 2 SES ee 
dj * Ny dik ~ Ny; 
k=1 


The “scan rate" over all instruments on the panel is the average number 
of fixations per second, given by 


The scan rate on a given instrument is called the “look rate,” 


given by 
= Ny 

foo =: 2 

si TR 


The fraction of fixations on the ith instrument, v3, is called the 
"look fraction,” 


Ny 
3 es 


i “N 


The "dwell fraction" is the fraction of time spent on instrument i, given 


by 
a @ 
ae TR 


This is also called the "fractional scanning workload." The "look interval" 


is the inverse of the scanning workload, i.e., 


a u 
a ae 
a 


The look interval is a measure of the recycle time, and it can also be 
computed from the individual scan intervals (the time between successive 


looks at an instrument). 


The six instruments and other regions of the panel were numbered for 
analysis as shown in Fig. 4. Looks at region 8 were usually blinks, and 
they resulted in the total workload on the instruments being less than 
unity. There were essentially no looks at regions 7, 9, and 10 in the 


data analyzed. 
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Figure 4. EPR Regions 


A typical segment of data is shown in Fig. 5. The major part of the 
dwell is well defined. The transitions between dwells take a small amount 
of time and may contain artifacts such as an overshoot, cross talk and 
fake looks (e.g., going from 5 to 1, passing over 2 but not dwelling on 
it}. The transitions are defined as having a duration no greater than 
0.15 sec. Typical vertical transition times (over all pilots) between 
instruments are in the range .06 to .09 sec. ~ The horizontal transitions 
are slightly faster, .05 to .08 sec. Additional details are given in sub~ 


section F. The difference probably reflects eyelid lag on the vertical 
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Figure 5. 


Tliustrative Data Sample 


channel, which varies between subjects. 


Tf the transition times are 


Longer than .15 sec they become an actual look, blink, etc. 


The transi- 


tion times are allocated to the adjacent dwelis in roughly equal propor- 
tions as shown in Pig. 5. The alternative procedure, deleting the 
transition times from the run, involves substantial reduction diffi- 
culties that are avoided by the method used. Detailed artifacts of 
the data such as scanning within a given instrument and blinks are 


discussed in subsection F, below. 


The nominal run length is at least 100 sec. Analysis starts with 
the first complete dwell after the digitizing tone. The data are then 
reduced for at least 100 sec, finishing with the end of a camplete dwell. 


A Fortran IV program was written to statistically reduce the EPR data. 
The output consistea of dwell time statistics and histograms for each instru- 
ment, summations for all instruments, and one way link transitions between 
The 


instruments. This program was run on a "Tymshare” remote terminal. 


following quantities were output for each instrument: 
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Total dwell time, Ty 
Number of fixations, Ny 
Mean dwell time, Tg; 

Dwell time standard deviation, ons 
Dwell fraction, ny 

Look fraction, vs 


Look rate, £5 


Dwell time histogram at .25 sec intervals 
The data for all instruments included: 


Total dwell time, }0T, 
Total number of fixations, Ny 


Scan rate, £2 


One way transition links 


The program required 220 statements, and it took approximately 5 min 
to process and type out the results of one run. The program allowed 
selected runs to be pooled together and processed as one long run. 


This gave the configuration averages for each pilot. 
B. SCANNING STATISTICS 


Over 100 EPR data runs were made, involving a total of seven pilot 
subjects and six configurations (A through F).. A cross section of 31 of 
the best runs were selected from these for detailed analysis. The 
remaining runs are available on magnetic tape. The select runs comprise 
an “experimental design,” shown in Table II. Each cell is denoted by a 
shorthand notation, e.g., Cl is Configuration C with Pilot 1. The con- 
figurations are described in Section II. The subject pilot backgrounds 
are given in Appendix D. Configuration A is not included, because it 
was a single axis task with no scanning. Pilot 1 was the principal 
subject and replications for each configuration are shown. Runs for 
Pilots 2 and 3 help define interpilot and interconfiguration differences. 


W 


Some of the range-varying runs involved a "visual breakout” and 


transition to an outside visual field display. This transition occurred 


oh 


TABLE IT 


RUNS ANALYZED IN DETAIL 


CONFIGURATION 


B 
(Split-axis manual IIS, 
fixed range) 


Cc 
(Manual ILS, fixed range) 


D 
(Manual ILS, varying range) 


E 
(FD, fixed range) 


F BL fe 
(FD, varying range) 


690219-17 


C2 
690219-16 
690219=19 
690219-21 
690219-23 
690219-25 


E2 


690219-18 
690219~22 
690219-24 


690219-5 


69021 7-15 
69021 9-) 

690219-10 
690219-11 
69021 9-13 


El 
69021 3-20 
69021 7-19 
690219~8 
690219-12 


F. 
690226-7 


690226-8 


690227-5* 


*Visual breakout occurred later. 


690228-~8* 


at least 10 to 15 sec after the 100 sec run interval, on verbal instructions 
Tt did not affect the pre-breakout data. 


from a "copilot" 


experimenter. 


The detailed scanning statistics for each of the 31 runs comprise the 


data base, and they are given in Table E-I of Appendix E. 


shown for each instrument and for all-instrument averages. 


Results are 


Averaging 


these data over a given pilot/configuration "cell" yields Table IIT, 


which is discussed in detail subsequently. 


TABLE III 


AVERAGE SCANNING STATISTICS 
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INSTRUMENT 6, IVSI 


Dwell time histograms for each of the cell averages in Table III are 
given in Figs. E-1 to E-5 of Appendix E. These aid in interpreting the 
tests of significance described below. Some of the histograms can be 


lumped, and this is accomplished as their homogeneity is established. 


The look rates, fg3> and dwell times, Tg,, in Table ITI were examined 
to determine similarities and differences among the pilots and configura- 
tions. The results of these statistical tests and other observations are 


discussed in succeeding sections. 
1. Stationarity Within a Run 


A key question in computing average scanning statistics over a 100 sec 
run is whether there is any significant change in the pilot's scanning 
behavior with time. One potential source of nonstationarity arises in 
the glide slope deviation bar and pitch flight director whose gains 
change in the range-varying configurations. Several of the range-varying 
runs were processed in three successive intervals and their statistics con~ 
pared, in order to determine if the scanning statistics were nonstationary. 
Table IV shows the mean dwell time and dwell fraction for each of the five 
instruments for three typical runs. These results show no important range- 
varying effects as discussed below, and the EPR can be considered statisti- 


cally stationary within a run. 


In general, the mean dwell times do not change significantly (at the 

95 percent confidence level) for successive thirds of runs. The dwell time 
on instrument 2 in the last one-third of Run 26-09 is significantly smaller 
than during the first two-thirds because the first 2 parts each have one 
very long dwell (i.e., 2.5 sec). If these long dwells are deleted there 

is no longer a significant difference. A comparison of Runs 26-05 and 
26-09 shows no significant differences for instruments 2 and 5. Other 
instruments were not analyzed in detail, because the number of Looks were 


too few for meaningful comparisons. 


The tests for significance were not performed on the dwell fractions, 


but these data do not show any consistent trends between runs and their 


variability is probably not significant. 


TABLE IV 


SCANNING STATISTICS FOR RUN SEGMENTS 


RUN ce RUN 26-09, RUN 26-07, 
ie D1 Tad 
INSTRUMENT INTERVAL 
[Rls pe [a [® | 


0-33 67 080 61 .056 LT -116 
33-67 -56 -050 .66 oe 65 -110 
67-100 54 


0-33 .78 -468 1.02 557 
33-67 84 529 84 ATT 
67-100 -71 


52 
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0-335 
33—_67 
67-100 


2. Peripheral Instrument Look Rates 


The peripheral instruments are the airspeed (No. 1), altimeter (No. 3), 
and rate of climb (No. 6). Their average look rates are given in Table ITT. 
These rates are based on a small number of looks (all are less than 10 per- 
cent) and they do not really warrant elaborate tests of significance. They 


are generally scattered, but some trends do emerge: 
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@ Similar configurations with the same pilot are 
about the same 


@ There are some large between-pilot differences 
with the same configuration 


Other look rate results are mixed. For example, in some cases the rates 
are larger with the manual IIS configurations than with the flight director, 


while others are the reverse. 
3. Primary Instrument Look Rates 


The average look rates on the primary instruments (ATT/FD and HSI/GSD) 
are given in Table ITT. On the attitude instrument (No. 2) the look rates 
are essentially the same over all pilots and configurations, except that 
the E2* look rate is significantly’ smaller. On the HSI/GSD instrument 
(No. 5) the flight director runs (Configurations E and F) have a signifi- 
cantly Lower look rate than the manual IIS runs. There is no difference 
between pilots within similar configurations, except that E2 is again 


smaller. 


The all instrument scan rates, f,, are canmpared using Table III. The 
B, C, and D runs are homogeneous among themselves as are the E and F runs. 
The variance in the means among the B, C, and D runs is significantly less 
than that for the E and F runs. The mean of the B, C, and D scan rates 


is significantly greater than the mean of the E and F scan rates. 


4, Peripheral Instrument Dwell Times 


The average dwell times, Taz, on the peripheral instruments are shown 
in Table ITI. The airspeed indicator mean dwell times, Ta,> show no sig- 
nificant differences over all pilots and conditions. Neither do the 
altimeter or rate of climb (IVSI) indicator. Furthermore, the IVSI and 


*He stands for Configuration E with Pilot 2. 


TAl1l significance tests were accomplished at the 95 percent confidence 
level unless otherwise stated. 
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altimeter mean dwell times are not different, but they are less than the 


mean airspeed indicator dwell times at a very high level of significance. 


These results are illustrated by the peripheral instrument histograms 
of Fig. 6. Some of the dwell.time variances are significantly different 
petween runs, due to unusually long dwells which occurred occasionally 


for some pilots. 


ALL PILOTS , ALL CONFIGURATIONS 


Altimeter and Rate of Climb Indicator 


Percent of 
Fixations 
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Figure 6. Peripheral Instrument Dwell Times 


5. Primary Instrument Dwell Times 


The average dwell times on the primary instruments (2 and 5) are shown 
in Table III. Four cases are of interest: each of the two instruments 


with manual ILS and flight director configurations. The comparisons are 


discussed below. 


Table V compares the attitude instrument (No. 2) dwell times over 
pilots for the manual ILS configurations. Configuration B is often 
different from C and D. A given pilot is about the same over minor 


configuration changes (e.g., C versus D), and these intrapilot data 


TABLE V 


MEAN DWELL TIME COMPARTSON; INSTRUMENT 2, 
MANUAL ILS CONFIGURATION 


EFFECT OF CONFIGURATION EFFECT OF PILOT 


can be lumped. The pilots are significantly different in the same task. 
The dwell time variances over these pilots and configurations are not 


significantly different, except that D3 is significantly larger than the 


rest. 


The comparisons for the attitude instrument (No. 2) with the flight 
director configuration are given in Table VI. The dwell time variance 


TABLE VI 


MEAN DWELL TIME COMPARISON; INSTRUMENT 2, 
FLIGHT DIRECTOR CONFIGURATION 


EFFECT OF CONFIGURATION EFFECT OF PILOT 


El = F 


for E2 is larger than the others, and the Fi variance is significantly 
smaller. Table VI shows that El, Fi, and F3 are the same and E2 is 
different. Thus, the Pilot 1 flight director data can be lumped, and 


there are some interpilot differences. 
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Comparing the instrument 2 dwell times between the manual ILS and 
flight director configurations shows the manual ILS to be less than the 
latter at a very high level of significance. The flight director dwell 
time variances are much greater than those for the ILS configuration, 


also. The results are illustrated by the average histograms of Fig. 7. 


Percent of 


Fixations CONFIGURATIONS C AND D, MANUAL ILS 
50 
Ta 2-775 
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CONFIGURATIONS E AND F, FLIGHT DIRECTOR 
50 
Tap = 62 


25 o, = 1.66 
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Figure 7. Attitude Instrument Dwell Times for Pilot 1 


The comparisons for the HSI/GSD instrument (No. 5) with the manual ILS 


configuration are given in Table VII. The B configurations are mixed. 


TABLE VII 


MEAN DWELL TIME COMPARISON; INSTRUMENT 5, 
MANUAL ILS CONFLGURATION 


EFFECT OF CONFIGURATION EFFECT OF PILOT 


Configurations C1, C2, and D3 are alike while D1 is significantly less. 
The dwell time variances for B, C, and D are homogeneous except Bi and 
Cl are greater than the others while the Be variance is significantly 


Less. na 


The comparisons for the HSI/GSD instrument with the flight director 


configuration are given in Table VIII. Here, the range-varying case has 


TABLE VIII 


MEAN DWELL TIME COMPARISON; INSTRUMENT 5, 
FLIGHT DIRECTOR CONFIGURATION 


EFFECT OF CONFIGURATION EFFECT OF PILOT 


El > Fi 


shorter dwell times, but there are no interpilot differences. The dwell 


time variances for these runs are scattered, i.e., 


Os ass 
Or SRO 
2 2 
Sry > ORS 
2 2 
oR, 7 ORY 


The Pilot 1 difference is in the same direction as the mean. 


The mean dwell times on the HSI/GSD instrument (No. 5) for the flight 
director runs are less than the manual ILS runs at a high level of sig- 
nificance. The dwell time variances in the flight director runs are much 
less, also. This is consistent with the attitude instrument (No. 2) 
result, of course, since instruments 2 and 5 are primary and they share 


most of the scanning workload. 


Changes in configuration involving fixed range versus varying range 
on the glide slope deviation have a significant effect on the HSI/GSD 
instrument dwell time as shown by the Pilot 1 data in Tables VIT and VITT. 


This may correlate with the larger glide slope deviations (per unit altitude 
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error) which occur as range decreases. None of the other-instrument dwell 
times showed a fixed versus varying range effect. Closer examination of 
the Pilot 1 dwell times on the HSI/GSD instrument indicates the following 
rank order (all differences are significant at the 95 percent level). 


ci > DI > Bi > Fi 


This resuit is illustrated by the average dwell time histograms in Fig. 8. 
6. Scanning Workload 


The dwell fraction, Ny also .called the fractional scanning workload, 
is the fraction of time during a run that the pilot is looking at that 
instrument. Average values for each instrument with each subject/ 
configuration are given in Table IIT. Tests of significance were not 


made but certain trends are obvious: 


ca] The dwell. fraction on peripheral instruments 
varies from run to run but there are no clear 
differences between pilots or configurations. 


@ ‘The dwell fraction on peripheral instruments is 
much less than that on the primary instruments 
(by definition! ) 


@ The dwell fractions on the attitude and HSI/GSD 
instruments are about equal with the manual ILS 
configurations. 


) The dwell fraction on the attitude instrument is 
much larger with the flight director configurations 
than with the manual ILS ones. 


@ The dwell fraction on the HIS/GSD instrument goes 
way down when the flight director is in use, and 
it becomes effectively a peripheral instrument. 


These differences in scanning workload are due mainly to differences in 
dwell time, and to some extent changes in scan rate as shown in Table IIT. 
For example, the unusually low E2 scan rate combines with the unusually 


long mean dwell time on the attitude instrument to give the highest 


observed mean scanning workload. 
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Figure 8, HSI/GSD Instrument Dwell Times for Pilot 1 
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C. ONE WAY LINK VALUES 


The "one way” link value, qs is the fraction of all real fixation 


3? 
transitions that go from instrument ito j. The fraction of fixation 
transitions in the opposite direction is dae The sum di + 54 is the 


"two way" link value and represents the fixation transitions between 
points i and j. Fitts, Jones, and Milton (Ref. 2) hypothesized that 
the Link values between instruments are indicative of the goodness of 
panel arrangements. If the pilot is stationary over a run, one way link 


values are also indicative of dominant scan patterns. 


The observed eye point of regard data have been reduced to show one 
way link values, and to determine the one and two way differences. Appen- 
dix E contains the link transition matrices for each of the pilot/configuration 
cells in Table II. Each matrix represents a lumping of replications. These 
results show that the major differences in transitions occur in going from 
the manual ILS task to the flight director task. There are also some dif- 


ferences between pilots in the manual ILS task. 


Typical link vectors for Pilot 1 in the manual ILS and flight director 
tasks are compared in Fig. 9. The width of the link vector represents its 
magnitude, and the diameters of the shaded instrument centroids represent 
the dwell fraction. The sum of the dwell fractions is less than one due te 
blinks. The data show no dominant circulation of scanning, and the one way 
link values are approximately equal. The flight director task has a more 
evenly distributed percentage of scans to secondary instruments, although 
a high percent of time was spent on the attitude/flight director indicator. 
There were very few (i.e., < 1 percent) link transitions across instruments 


indicating the primary instruments were centrally located. 
D. PERFORMANCE MEASURES 


Mean square values of important response signals were computed. 
Particular attention was paid to the longitudinal stimuli, pitch attitude 
and glide slope deviation error, and elevator response. These are discussed 


below. 
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Flight Director Configuration, E/ 


Figure 9. Typical Transition Link Vectors 
and Dwell Fractions 
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The root mean square glide slope errors for Configurations B, C, 
and D are given in Fig. 10. Run 27-3 is anomalous, bécause the pitch 
attitude and glide slope forcing functions were inadvertently (almost 
50 percent) too large. Assuming a glide slope error signal bandwidth 
of about 0.3 rad/sec gives 10 degrees of freedom in a 100 sec run, and 
permits tests of significance using the F-distribution. Paired comparisons 
showed no significant differences* over pilots and configurations (B, C, 
and D). Their overall average is significantly greater than the glide 


slope deviation forcing function as shown in Fig. 10. 


The rms glide slope errors for the flight director configurations are 
plotted in Fig. 11. The bandwidth is assumed to be 0.3 rad/sec. Run 27-5 
is significantly larger than the others, but this may be associated with 
the pilot's use of unusually large throttle corrections during this run. 
Paired comparisons on the remaining points show no significant differences, 
with the possible exception of F3 which is borderline at the 95 percent 
level. 


The nondifferent E and F mean square values were lumped and campared 
with the lumped B, C, and D results. The flight director runs had 
Significantly lower glide slope deviation error than do the manual ILS 
runs. This correlates with the scanning statistics on instrument 2 which 
show that the look rates are higher and the dwell times are longer (larger 
dwell fraction) with the flight director configurations. 


The rms pitch attitude errors are plotted in Figs. 12 and 13. Assuming 
a signal bandwidth of about 1.5 rad/sec gives 50 degrees of freedom per run 


and permits tests of significance. 


The Ci data in Fig. 12 show a significant increase in error during a 
session (e.g., 19-4, 10, 11), but no apparent day to day differences; 
i.e., it starts at a lower level on a different day and progresses. Other 


configurations and subjects don't show this within-session trend. The Cl, 


*The 95 percent confidence level is used in all significance tests 
unless otherwise noted. 
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Figure 11. Glide Slope Performance with Flight Director Configurations 
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Di, and C2 data show run to run scatter which tends to mask differences 
petween subjects and configurations. The D3 pitch attitude errors are 


significantly smaller than the others, reflecting a difference in Pilot 3. 


Paired comparisons of the flight director pitch attitude errors in 
Fig. 13 show one or two significant differences but no trends. The E and 


F data are generally the same. 


The manual IIS and flight director pitch attitude results can be 
compared using Pilot 1 data. Ci and Dl are significantly larger than 
El and Fl. This is the same difference that occurred with glide slope 


deviation errors. 


Mean square measures of elevator response, 82, 


comparisons were not made, but the flight director runs generally had larger 


were computed. Detailed. 


values than the manual ILS runs. The run to run variation in 82 correlates 


better with 62 variations than with Be This is not unexpected, since 


8 —~8, is the dominant inner loop. 


Mean square elevator_and aileron were cross plotted for the various 
runs. There was no particular correlation between the two, indicating 
that crosstalk between the axes of control was smail, as expected. 


E. COMPARISONS WITH OTHER EYE SCANNING DATA 


The largest and most thorough data on pilot eye movements were collected 
by Fitts, Milton, Jones, McIntosh, and Cole in a continuing program from 
1949 to 1952. The Fitts data were obtained from eye camera films of 40 
subjects in a C-45 aircraft. Of the eight individual reports, four were 
coneerned with routine IFR flying, and four with the landing approach 


phase. These four studies are listed as Refs. 2 to 5, respectively. 


Similar, but more recent, measurements have been made by Senders in 
Ref. 12, utilizing electro-oculograms (EOG) of three subjects in a fixed 
base simulator. The panel arrangement was identical to the standard 


instrument arrangement used by Fitts in Refs. 2 and 3 and shown in Fig. 14. 
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Pigure 14. Standard Instrument Arrangement Used 
by Fitts (Refs. 2 and 3) and Senders (Ref. 12) 


An experimental panel used by Fitts in Refs. 4 and 5 is shown in 


Fig. 15 and more nearly resembles the panel arrangement used in this 


program. Neither Fig. 14 or 15 is similar to the DC-8 panel used in 


this program. 
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Figure 15. Experimental Instrument Arrangement 
Used. by Fitts (Refs. 4 and 5) 
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The last report of the Fitts series (Ref. 6) was concerned with flight 
director* approaches. Measurements were made of 10 pilots who each flew 
one approach from the rear seat of a T-335 aircraft. The flight director 
indicator was a separate instrument as can be seen from Fig. 16. With this 
exception the panel was very similar to the experimental instrument arrange- 


ment of Refs. 4 and 5. 
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Figure 16. Panel Arrangement Used by Fitts (Ref. 6) 
for Flight Director Approaches 
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Table IX compares dwell fractions from Fitts (Refs. 2 and 4) and 
Senders with those from the DC-8 simulation. Since these past data do 
not include flight director approaches, only Configurations C and D are 
used. The individual dwell fractions of the directimmal gyro display 
and the cross-pointer display for the past data were summed to compare 
with the dwell fractions for the integrated HSI/GSD displey in the STI 
data. The sum of the dwell fractions (workload) on instruments in these 
tables is less than unity; due to blinks (and looks at 4) in the STI data, 
and because other (noncomparable) instruments were present in the other 


data. The comparison of available mean dwell times is presented in Table X. 


*Zero reader. 


ke 


TABLE IX 
COMPARISON OF DWELL FRACTIONS WITH PAST DATA 


DWELL FRACTION 


*Average of 53 pilots (Configurations C and D) 
TAverage of 2 pilots (Phase IIT) 


*taverage of 40 pilots (instrument low-approaches) 


TABLE X 


COMPARISON OF MEAN DWELL TIMES WITH PAST DATA 


*Weighted average of 3 pilots (Configurations C and D) 


The two way link values for the weighted average of the three pilots 
in Configurations C and D is shown in Table XI along with the experimental 
panel results of Fitts (Ref. 4). Since the number of instruments differed 
a direct comparison is not meaningful, however, the primary link in the 
Fitts data is XPT-~DG which is the currently integrated HSI/GSD display. 
Combining the second largest link, XPT-GH, with the XPT-DG would approximate 
the current HSI/GSD-ATT link value. 


TABLE XI 


COMPARISON OF AVERAGED TWO WAY LINK VALUES 


LINK VALUE 


HSI /GSD-AS XPT-AS 
HS I/GSD-ATT XPT-GH 
HSI/GSD-PALT : XPT-~PALT 
HST/GSD-IVSI Z XPT-VS 
ATT-AS XPT-DG 


ATT-PALT . GH-AS 
ATT-IVST - GH-ALT 
AS-IVSI GH-VS 
AS-ALT AS-PALT 
AS-DG 
GH-DG 
VS-DG 
PALT-DG 


Tables IX, X, and XI serve to compare rather than evaluate the data. 
There are many differing factors in the three sets of data which would 
influence the results. For example, the gyro horizon was just replacing 
the "needle-ball-airspeed" technique during the period of Fitts' studies. 
The current technique supported by nearly all pilots rests primarily on 
attitude control and therefore has a higher fractional workload and 
associated dwell time. The peripheral instruments (i.e., PALT, IVSI) 


are comparable and do show similar workloads and dwell times. 


yh 


The scanning rates should be heavily influenced by the vehicle dynamic 
properties, stability and responsiveness. For the same dwell time the 
seanning workload will be directly proportional to the scan rate (i.e., 
Wg, = Ta;fs;)- Additional factors noted by Fitts as having a significant 
effect on the dwell time and fraction were interpilot differences, day 
versus night operation, and manual ILS versus ground controlled approaches 
(GCA). 

The GCA data is compared in Refs. 3 and 5 for the standard and experi- 
mental panel arrangements, respectively. Table XII summarizes the Ref. 3 
results. This shows that the glide slope-localizer pointers were not looked 
at during the entire approach. The engine instruments and turn and bank 


indicator were not included in the Table XIT data. 


TABLE XII 
RESULTS FOR NIGHT GCA APPROACHES IN C-5 (FITTS, REF. 3) 
TWO-WAY 


FRACTIONAL 
LINK VALUES 


DWELL 
FRACTION 


AS-DG 
AS-GH 
AS~ALT 
AS-VS 


DG-GH 
DG-ALT 
DG-VS 
GH-ALT 
GH-VS 
ALT-VS 


The flight director data of Ref. 6 is shown in Table XIII with those 
obtained from the DC-8 simulation (Configurations E and F combined). The 
dwell fractions (fractional scanning workload) can be added and as such 


compare very closely with the current attitude/flight director result. 
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TABLE XTIT ee 


COMPARISON OF FLIGHT DIRECTOR EYE TRAFFIC WITH PAST DATA 


FLIGHT 
DIRECTOR 
ATTITUDE 


ae / 


GLIDE SLOPE 
HEADING 


ATRS PEED 


VERTICAL 
SPEED 


ALTIMETER 


Mean dwell times, a parameter likely to be independent of vehicle charac-. 
teristics, exhibits the same trends between instruments and possibly exhibits 
an additive property for integrated displays. The total scan rate in the 

Ref. 6 study was 92/min or 1.53/sec. This compares to the .89/sec in the 

pC-8 study. The scan rates show the flight director receives the most 

frequent looks. The large number of miscellaneous scans in the Ref. 6 data 
was due mainly to unresolved looks. It aiso included looks at the rpm, exhaust 
temperature, and turn and bank indicators, blinks and looks at switches. The 


relevant data comparison is consistent. 


The link values recorded in Ref. 6 support the finding that the one-way 
links between pairs of instruments are approximately equal, and that the 
flight director is the center of attention. Table XIV presents the link 
values between pairs of instruments, disregarding the values less than 


2 percent. The STI data are for Configurations E and F combined. 
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TABLE XIV 


COMPARISON OF AVERAGED TWO-WAY LINK VALUES WITH PAST DATA 
WITH FLIGHT DIRECTOR DISPLAYS 


FD-ATT 
FD-AS 
FD-PALT 


FD-Vs 
FD-REM 
ATT-RPM 
FD-T&B 
FD-HSI/GSD_ 


F, DETAILED FEATURES OF THE EPR DATA 
1. Artifacts and Details 


several fundamental eye movement artifacts were observed in addition 
to the desired dwell properties. These include details related to transitions 
between instruments, Looks within an instrument, and blinks. Figure 17 shows 
typical horizontal and vertical EPR recordings at slow and high paper speeds 


in Which these three features are apparent. 


Transition times were taken as the 10-90 percent rise time in a look 
from one instrument to another. This typically was between .05 and .1 sec 
+.01 sec for all subjects. The transitions were slightly (i.e., approximately 
-01 sec) slower in the vertical direction than in the horizontal. This is 
most likely due to the eyelid response from which the vertical motion is 
detected. 


On many runs the EPR system was calibrated such that it was able to 
detect 1 deg to 2 deg changes in eye movement. On instrument 2 for example, 
it was possible to distinguish looks between the pitch bar and the bank angle 
sky pointer. On the HSI/GSD display, instrument 5, the glide slope bar could 
be distinguished from the heading bug. 
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Blinks are easily distinguishable artifacts. The interruption time may 
not be equal to the blink time, because the vertical motion sensor uses the 
eyelid. The mean blink time was .27 sec and typical within-run standard 
deviations varied from .O7 sec to .25 sec for different subjects. It has 
been found in some subjects that the eyelid lag can completely mask the true 
vertical motion. There will be some horizontal voltage change for a purely 
vertical eye movement, because the infrared sensors cannot be located exactly 
on the iris periphery. This artifact is called crosstalk and can be used to 


check the eyelid tracking ability. 


One additional artifact resembling’ a blink but of significantly 
shorter duration was attributed to eyeball saccades. The saccades were 
less than or equal to .1 sec and were not removed from the dwell time 


data. The saccade time was equally distributed to adjacent dwells. 
2. Dwell Time Quantization 


Some of the manual IIS data for Pilot 1 were quantized into .05 sec 
intervals to determine if there was any tendency for the dwell times to 
be multimodally distributed (bunched at discrete durations). The results 
are shown in Fig. 18 for the attitude indicator and the horizontal situation 


indicator. 


These distributions are similar to the ones obtained for the coarser 
intervals and do not exhibit any particular multimodality. These and 
other distributions were generally limited to a minimum value of about 
-25 sec with a positive skewness. The individual runs did not appear to 


differ significantly from the pooled results. 
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Figure 18. Finely Quantized Dwell Time Histograms 
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SECTION IV 
SUMMARY AND CONCLUSIONS 


The major conclusions of the phase of the program described in this 
report relate to the utility of the eye point of regard system and to the 
eye scanning traffic results. These reduced data are in a- form suitable 


for correlation with the simultaneously recorded pilot and system response. 
A. EYE POINT OF REGARD SYSTEM 


The EPR system worked satisfactorily throughout these experiments. Six 
of the seven subjects were able to wear it without discomfort for periods of 
half an hour. The seventh had a dental problem and could not hold the head 
movement device. The pilots felt they could wear it for in-flight measure- 
ments. Once fitted, it could be reinstalled and nulled in about 5 min. 


Observed performance attributes included: 


@ ODrift-free operation for 2 min 


@ Always resolved looks between instruments (3 deg 
to 5 deg), and frequently resolved looks within 
a single instrument (1 deg to 2 deg). 


e Produced vertical and horizontal coordinates 
suitable for direct entry into a digital processor. 


The unit experienced only one failure in 3 months of almost daily operation, 


during which time well over one hundred 2 min runs were made. 
B. MEASURED SCANNING TRAFFIC 


The scanning traffic includes individual instrument dwell properties 


and scanning among the instruments. 
1. Statilonarity 


The scanning data during the range-varying runs were examined for 
statistical stationarity. No systematic differences were found in 


successive 33 sec intervals. 


51 


2. Look and Scan Rates 


Look rates involve the scanning frequency on a given instrument while 


scan rates involve the entire panel. The results show: 


@ The attitude or attitude/flight director instrument 
(No. 2) look rates are generally the same over ail 
pilots and configurations. 


@ The HSI/GSD instrument (No. 5) look rates are 
significantly lower for flight director than 
manual ILS runs. 


@ The peripheral instrument look rates are scattered 
and show no strong trends. 


@ The all-instrument scan rates are significantly 
greater for the setae TLS runs than for the flight 
director runs. 


These results correlate with the dwell time and workload results summarized 


below. 
3. Peripheral Instrument Dwell Times 


The dwell time is the average length of one instrument fixation. The 


peripheral instrument results show: 


@ Mean dwell times on the altimeter instruments (No. 3) 
and IVSI (No. 6) are homogeneous over all pilots and 
configurations, and are not significantly different 
from one another. The mean is .42 sec. 


@ The mean dwell times on the airspeed instrument (No. 1) 
are homogeneous over all pilots and configurations, and 


their average (Ta, = .64 sec) is significantly greater 
than the other peripheral instruments (3 and 6). 


There is no evidence of quantization in the individual dwell times. 
4, Primary Instrument Dwell Times 


The dwell time results on the attitude gyro (No. 2) and the HSI/GSD 


(No. 5) for the various pilots and configurations show: 
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@ Mean dwell times on the attitude and HSI/GSD 
instruments for Configuration B are often 
different fran C and D, indicating that the 
additional lateral axes of control have an 
effect with some pilots. Recall that bank 
angie is on 2 and localizer deviation and 
heading are on 5. 


@® Differences between fixed and varying range 
had no effect on the attitude instrument dwell 
times for either the manual ILS or flight 
director configurations. Intrapilot data 
on similar configurations can be lumped. 


@ Fixed versus varying range had a significant 
effect on the HSI/GSD instrument dwell times 
for both manual TIS and flight director con- 
figurations. In each case the varying range 
version had a shorter mean dwell time. 


e The mean dwell times on attitude instrument 
with the manual ILS configurations are less 
than with the flight director at a very high 
level of significance. The dwell time variances 
are also much less. 


@ ‘The dwell times on the HSI/GSD instrument show 
the opposite trend. The manual ILS means are 
greater than the flight director means at a high 
level of significance, as are the dwell time 
variances. 


@ These resuits are consistent, because attitude and 
localizer/glide slope are primary and share 80-90 per- 
cent of the scanning workload. 


e Interpilot differences in mean dwell time on the 
primary instruments often occurred. These were 
most pronounced on the attitude instrument with 
the manual IIS configuration, and did not oceur 
at all on HSI/GSD instrument with the flight director. 


5. Fractional Scanning Workload 


The dwell fractions (percent of time fixating) on the attitude 
instrument are much larger with the flight director than with the manual 
ILS configurations. In the flight director configurations, the HSI/GSD 
instrument workload goes way down and it becomes essentially a peripheral 


instrument. 


6. Transition Links 


There is a big difference between the manual ILS and flight director 
configurations, related to the big difference in scanning workload. The 
manual ILS restlts have dominant links from attitude to HSI/GSD and back. 
The flight director links appear more "scattered," because these central 
links are relatively smaller. The one-way link vectors are about equal in 
opposite directions (e.g., 2 to 5 = 5 to 2) so that two-way links can be 
used. This is closely related to the observation that the scan patterns 


show no strong evidence of "circulation." 
C. PERFORMANCE MEASURES 


Mean-square values of system errors and control actions for the various 


runs show the following: 


@® Glide slope deviation errors are about the same 
over the split-axis and manual ILS configurations 
(B, C, and D). 


@ The glide slope deviation errors are about the same 
over the flight director configurations (E and F). 


@ The glide slope errors with the flight director are 
less than with the manual ILS configurations. 


@ The glide slope deviation errors are larger than 
the glide slope command in all cases. 


@ The pitch attitude errors are less with the flight 
director than with the manual ILS configurations. 


@ The mean square elevator activity is greater with 
the flight director. 


D. COMPARISONS WITH OTHER DATA 


The current eye scanning data (dwell times and fractional scanning 
workload) are generally consistent with the results of prior research 


(e.g., Fitts, et al; and Senders) where meaningful comparisons can be 
made. 
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Most of the Fitts and Senders data were taken with the then standard 
panel, which differs from the current T-layout. Nevertheless, their 
results can be compared with current nonflight director data. The STI 

data show a larger dwell fraction on the gyro horizon than past data. 

The dwell fraction for the HSI/GSD instrument in the STI data is less 

than the lumped dwell fraction for directional gyro and crosspointer 

in either the Fitts or Senders results. There are only minor differences 
in other dwell fractios. The dwell times are similar among respective 
peripheral instruments and between the then primary and the current primary 
displays. Differences in dwell fraction can be attributed to differences in 
panel arrangement, and to the evolution of a pilot technique using attitude 


control. 


Fitts also studied an experimental panel with crosspointer and gyro 
horizon instruments in the center, adjacent to a flight director instrument. 
His dwell fraction data agree well with the present (flight director config- 
uration) data for most instruments. The exception is that the STI data show 
a larger dwell fraction on HSI/GSD than does the sum of his crosspointer and 


DG data. The respective dwell times are comparable. 


The comparison of link values between past and present data is not too 
meaningful, because the major link in the Fitts data (FD-ATT), for example, 


is now eliminated with a combined instrument. 


a? 
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APPENDIX A 


EQUIPMENT DESCRIPTION 


OVERALL LAYOUT 


The experiments were performed using the De-8 Landing Simulator of the 
Man-Machine Integration Branch at NASA Ames Research Center. This facility 
is divided between two buildings; one housing the analog computing equipment, 
recorders and master control, and the other housing the fixed-base cockpit, 
visual display and instrument bays. The mechanizations, interconnects, 
etc., were set up by NASA at the outset and were simply utilized for these 


experiments. 


The computer room is a fairly compact area focused around the 
AD-256 analog computer. All trunking to and from other equipment passes 
through selectable tie points on its console. Trunk lines, including 
communication, connect the simulator building, approximately 100 ft away, 
with the computer room. The instrument bay receives the analog signals 
inside the simulator building and drives the instruments in the cockpit 
another 100 ft away. The pilot completes the loop by actuating the controls 
which send signals back to the computer room. 


COMPONENTS 


The flow diagram and specific functions performed by the individual 
components are shown in Fig. A-1. A brief description of each component 


is given below. 
Input Tape 


The forcing functions and tracers presented to the pilot were contained 
on A. R. Vetter Model A, FM tape recorder. It had seven FM-i00 record 
channels and 1 DC record channel. It used 1 /* inch tape and was operated 
at 7.5 inehes per second. The FM channels are 100 Hz bandwidth with center 


frequency 2.2 KC +80 percent modulation (non IRIG). Noise with grounded 


input is about 42 dB down at bandcenter. 


P ign FM Brush Brush 


COCKPIT AND PILOT 


Attitude(8,p,) 
Displacement (y,h 


ATR-48 j 


Autopilot 
Flight Dir. 
Perf. Meas. 


) 


Command Inputs (@L, €6s,) to fit. dir, 


Figure A~1. Signal Flow Diagram and Equipment Functions 


TR-LS Analog Computer 


An Electronics Associates, Inc. (EAL) TR-k8 portable analog computer 
served to scale the input signals, compute the flight director and auto- 
pilot dynamics, and record several on-line rms signals. The mechanization 
utilized 48 amplifiers, 4 quarter square multipliers, 3 double pole relays, 
h5 pots and 10 switches (7 external). Forty trunk lines provided communi- 
cation to the AD-256 canputer. 


AD-256 Analog Computer 


The Applied Dynamics analog computer contained the major mechanization. 
This included the 6 degree of freedom vehicle dynamics, direction cosines 
for body to inertial axis transformations, Euler angles, glide slope and 
localizer computations, performance measures and considerable digital logic 
for switching, data recording, etc. The computing elements included 250 
bipolar amplifiers, 20 quarter square multipliers, {7 function generators, 

3 external resolver racks, and over 150 pots. 160 trunk Lines connected 


the computer with the simulator building. 


Instrument Bay 


Computed signals from the AD-256 were conditioned by an EAI analog 
computer in the instrument bay in order to properly drive the cockpit 
instrumentation. Over 50 amplifiers and pots were required. The scale 


factors for the instrument drives were not derived. 
Cockpit 


A separate room contained the fixed-base cab, hydraulic force feel 
system, and EPR setup. The background engine sound system was not 
available and the visual display was not used.* The environment was 


somewhat noisy due to the hydraulic force feel system. The pilot station 


*The visual display system was used in a few unscheduled "visual 
breakout" runs as noted in Section ITI. 
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was similar in layout and dimension to that of a large jet transport 
aircraft although actual subsonic jet hardware was not used. The instru- 
ment panel configuration, meter properties and force feel system properties 
are discussed in Appendix B. A remote OPERATE, HOLD, RESET switch allowed 
the pilot to independently operate the analog computer when appropriate. 


Eye Point of Regard (EPR) System 


The EPR apparatus and the experimenter were located directly behind 
the pilot. ‘The purpose of the EPR system is to provide a simple measure 
of the intersection of the visual line-of-sight and a selected normal 
picture plane in an instrument scanning situation. The apparatus measures 
the angle of the eye in the head by corneal-scleral reflectance, and the 
motion of the head with respect to the reference point electromechanically. 
These two quantities are summed appropriately to obtain the net point-of- 


regard for the eye/head combination. 


The output of the EPR system was displayed on a CRT. By drawing the 
panel layout to scale on a CRI mask, the instruments being fixated could 
be seen as the EPR dot moved over the field. 


Figure A-2 shows the EPR setup and components. Their installation on 
a subject is shown in Fig. A-3. The fundamental components are the eye 


movement device (EMD), the head movement device (HMD), and the EPR computer. 


The head movement device is an electromechanical sensor connected by a 
telescoping linkage to an anchor point on the instrument panel. The nominal 
angular range of the HMD is +ho° horizontally and +20° vertically, with 


resolution of about +1° in either axis. 


The eye movement device used was a Space Sciences, Inc., Model SGHV~2 
designed to measure the horizontal and vertical movement of the eye with 
respect to the head by a corneal-scleral boundary contrast technique. Its 


operation depends on 


"|. detecting the changes in reflected light between the 
white sclera and the left and right sides of the iris when 
making horizontal measurements, and between the eye itself 
and its upper lid for vertical measurements. The pulsed 
IR light source illuminates the eye with invisible light. 


Anh: 


Instrument 
Panel 


Not to Scale 


Horizontal 


EPR 
Computer 


Instrument 
Panel 
Overlay 


EPR Monitor (CRT) 


Figure A-2. EPR System Components 
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Figure A-3. Use of EPR System 


The transducers are placed close to the eye, each facing 
the eye, one from the left side and the other from the 
right side. The photodiodes are fast response devices 
sensitive in the near-infrared region. In both cases an 
amplifier-demodulator acts on the current produced by the 
diodes to yield a single ended, low impedance, output 
voltage proportional to the angular displacement of the 
eye." (Quote from the SGHV-2 operation manual) 


The vertical and horizontal eye movement voltages are filtered, t= .016 sec, 
to reduce AC pickup. The usable angular range of the EMD is +20° horizontally 
and +10° vertically with accuracies of 1° ana a, respectively. The EMD is 


self~contained with rechargeable batteries. 


The eye point of regard computer is a special purpose miniaturized analog 
computer which combines the horizontal and vertical eye and head angles to 
yield the coordinates of the eye line-of-sight intercept with the display. 

It is a solid state device, powered by 115 VAC line. Potentiometers control 
HMD zero offset, gain, and crosstalk with the EMD. The EPR computer output 
provides linearized eye angles of O to +10V horizontally and vertically, 
linearized head angles of O to +15V horizontally and vertically, and total 
EPR angle of O to +10V. Offsets and drift were less than 5 mV. 


A sample of the output for the 6 meter calibration is shown on Fig. A-h. 


Recorders 


Pertinent data recording was done by an Ampex Model CP~100 FM magnetic 
tape recorder. Thirteen FM channels were set up with center frequency 
3.375 ke and recording was done at 3.75 ips (marrow band). The heads were 
TRIG configuration. The remaining channel was set up for direct voice 
record since no edge track was available. Input voltages of +1.414v 


provided +140 percent modulation. 


In parallel with the FM recorder were two 8 channel linear Brush strip 
chart recorders. Another 8 channel Brush was used for monitoring the FM 


output to ensure good quality recording. 
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APPENDIX B 
CONTROLLED ELEMENT FROPERTIES 


VEHICLE DESCRIPTION 


The linearized model of the DC-8 in the landing approach configura- 
tion was derived from data used in the NASA simulation. It specifies 
nonlinear lift and drag characteristics, but at small angles of attack 
this effect is minimum and straight-line slopes are representative. Other 
nonlinear data are added due to ground effect, but they have no influence 
on the basic data for altitudes above 80 ft. Linearized perturbation equa~ 
tions are adequate for this analysis, and the longitudinal body-fixed 
stability axis and lateral body axis equations of Ref, 17 are appropriate. 
These are given below. 


Longitudinal Body-Fixed Stability-Axis Perturbation Equations 


8s —Xy Ky & COS 7 u XBe Xsn kw] Pde 
—Ly s—Zy Vips +g sin Yoh | ¥] = | 25, Zap Sy FF OT 
MM, —(Ms +M,) s°—M,s 8 M5 6 Mon Ml ¥e 

Ah = -W cos 75 + u sin 79 + (Vito COS %)e@ = Vtg sin y 


Lateral Body-Axis Perturbation Equations 


: & 
ae —|(sin Sp) 8 * Tgp 008(e0 + 70)| (cos 9) 8 Fp SiM(Gn + 70) 6B Se Ys, 
tyz, 
Lg s(s—Lp) ~[Rte? + ty e =|is5, Ig. 
Ixz 5 r 

Np = ist +Nps s(s—N,.) es Ng. Ng, 

= . 1 

gp = ptrtan(at+7%) § Y = 


cos(ay + 7%) 


(B-1) 


One landing approach flight condition was used with an approach speed 
of 135 kts, gross weight of 180,000 lbs, flaps 50°, and gear down. The 
yaw damper was asswned on. No other augmentation, such as autothrottile, 
was used. For the frozen range configurations (B, C, and E), the aircraft 
was trimmed straight and level (a, = “62°, Se, = 2» Th = 23,700 lbs) 
at a range of 30,000 ft and 1,650 ft altitude above ground level. The rate 
of climb and pitch attitude meters were appropriately biased, and the 
altimeter was driven by an integrator to make the display represent descent 
along the 3° glide slope. For the range varying configurations (D and F) 
the aircraft was retrimmed for descent on a 3° glide slope and no meter 


biases were needed. All prelanding check lists were assumed complied with. 


The dimensional stability derivatives for this flight condition are 
given in Table B-I which also includes a comparison with a typical jet 
transport (Boeing 707-320) used in a previous study, Ref. 18. The Ref. 18 
data in Table B-L. have Cig corrected to —18.0 in accordance with NASA 
TN D-3159, Ref. 19. 


The longitudinal transfer functions are given in Table B-ITI and the 
lateral transfer functions are presented in Table B-IITI. 


Transient responses were computed from the given transfer functions 


for 


e 10° Se pulse held for 1 sec 
e 5° 8, step 
@ 5° 8, step 


Figures B-1, B+-2, and B-%3 present the respective vehicle response to 

these inputs. The solid lines are the analog responses. The dotted 

lines in Figs. B-2 and B~3 are theoretical results from the linear transfer 
functions. 


FLIGHT DIRECTOR PROPERTIES 


The flight director already mechanized on the NASA simulator was used. 


The equations for the longitudinal and lateral directors are given below. 


Linear units are feet, angular units are radians. The units of the flight 


e-d 


GEOMETRY ; 


h 
M 
Vay 
70 


(ft) 

(=) .20 
(ft/sec ) 223, 
(deg) -2,86 
(lb/ft) 59.2 
(£t®) 2890. 
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TABLE B-I 


AMES DC-8 SIMULATOR PARAMETERS FOR LANDING APPROACH CONFIGURATION 


t) Wye. 


: 
LONGITUDINAL 3% z ; } LATERAL % , 
STABILITY AXES 107-520" | nopy axes | DC-8 | 707-320 


Xy (1/sec) 
Xy (1/sec) 


(1/sec) 
(1/sec) 
Ze (=) 


ft) 
1b) 
slugs ) 
slug-ft*)13.2% 10 
slug~ft2)13.8 x 10° 


22.7 
. 1181000. 
5,590. 
3.3 x 108 
5. x 106 


slug~ft2)16.6 x 10818.3 x 108} 


My (1/£%) 


Mg (1/8ec) 


Ms,(1/sec®) 


(1/sec#) 
(1/sec) 


Ty, Ty, Ty, and Ty, are given for Body Axes, 
*Simulated, 
"Ref. 


18 for comparison, 


Xp, (ft/sec/rad) 
Xan(£t/sec®/f) 


Zp, (ft/sec*/rad ) 
Zgq(ft/sec*/h) 
M, (1/sec-ft) 
My (1/sec-ft ) 


Mgq(1/sec*/#) 


~0.0356 
0.103 


(1.0 ref) 
0.289 
—~0.585 


~7.65 


0.000139 
0.0026 
0 
-0.87 
0.619 


0.00685 XS 
—0.581 


Yy (1/sec) |-0,0887/ -0.112 
(1/sec) 

Yee (1/sec) 

Lg ( (1/sec2) 

ly (1/see) 

ly (1/sec) 

Les (1/seo®) 

Tg. (1/sec®) 

Ne (1/sec®) 

Ny (1/sec) 

Ny (1/sec) ~0. +257 

Nee (1/sec®)| 

Nn (1/sec®)|~0.368 


TABLE B-IT 


LONGITUDINAL STABILITY AXIS TRANSFER FUNCTIONS FOR 
THE DC-8. IN THE LANDING APPROACH CONFIGURATION 


A = [0.0865 ; 0.166][0.627 ; 1.23] * 


N5q = —0.915(0.101)(0. 646) 
Neg = —1-258(-4.12) (4.03) 


Ng. = ~9.25(23.3) [0.090 ; 0.198] 
Se. = 9.25 (3.63) (0.0352) (4.42) 
N5p = 0.82 x 107(5.) (31.1) 


Nan = 6. 106(—0. 0009) (0.636; 1.22] 
Nn = -0.00097(31.1)(0)(0.59) 
Be = —0.00097(0.38)(1.02)(31.1) 
Nggbp = 0-0009(31.1) 
Ngehq = —0-097(0.709) 
Nebr = —0.98(-0.0013) (23.3) 
ee = ~0.0009(31.1) 
wb, = —0.203(31.1) 
web, = ~0-98(-3.65)(4.41) 
wh = —0.75(0.871)[0.113 3 0.254] 
Nig = 0.004(~0.0087) (0.0378) 
Wie = —0.136(0)[0.407 ; 0.975] 
m8 = 0.649(0.092) 
0 _ Be ou 
Bs ay ae ete.3 NSeSq etc., are coupling numerators (see Ref. 17). 


*Polynomial factors: Throughout this appendix Als + 2tws +a] is 
written A[€;w] ; and A(s+a) is written A(a). 


Bola 


TABLE B-IIT 


LATERAT, BODY AXIS TRANSFER FUNCTIONS FOR 
THE DC-8 IN THE LANDING APPROACH CONFIGURATION 


A = (0.0467)(1.18)[0.107 ; 0.728] 
Ng, = —0-032(—1.35)(1.33) 


Ne, = 1.15[0.277; 0.625] 


Neo = 0.01(0.213)(19.42) 
Ng, = 7~0-367(1.19)[~0.097 ; 0.397] 
Ns, = 0-159(-2.37) (1.34) 
Ne. = 0.031(—0.043)(1.16)(12. 16) 

NE By = 0.035(—0.00002) (12.2) 

Ns 8 = 0.0026(22.18) 
sr 

Ny Se = -0.415(0.058) 

Ne Ne 
B = — F 5 = _ 5, ete. NE 5 , ete., are coupling numerators. 
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Figure B~3. Open-Loop Transient Response to 5° Rudder Step Input 
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director are arbitrary and determined by the instrument scaling. The 
approximate display scalings using pitch and roll angles. as references 
were: 1 rad FD, + 6 rad of displayed 63 1 rad FD, = 0.10 rad of 
displayed o. 


Longitudinal 


FD, = -6(9.0005n, + 95) 5 radians 6 (B-3) 


he is the altitude deviation from a given glide slope (in ft) and it is 
computed by multiplying the angular glide slope error, ¢qg, by the range 


to glide slope transmitter. 


Lateral 
0.62s ; 
TED Ost a ee 29, ai. ate 
1 CEREOTEECEG Sete et 2106 | > radians mp (B+) 
E = 8.6y + 0.99 + 9T-5€r9, +» radians 


€roc is the angular deviation from the localizer beam (in rad). It can 
pe transformed to lateral displacement (y) by multiplying by the range 


to the localizer transmitter. Positive deviations are to the right. 


It is important to note the influence of variable range on these instru- 
ments. Since altitude error is used in the longitudinal director, the 
dynamics are unaffected by range, but any angular glide slope noise will 
be attenuated in the flight director as range decreases. In the lateral 
flight director, noise would not be attenuated and the instrument becomes 


more sensitive as range decreases. 


The open-loop transfer functions calculated for a localizer range of 
45,000 #t (approximately 30,000 ft from threshold) are: 


FD eens . Sele ta e 
FD Ngo” —6 x 0.453(0.048)(0.065)[0.8 3 O78] 


== = oat Soh Se ee oe ep he a ee (B-5) 
e ‘Long (0)(0.082) [0.087 ; 0.166] [0.63 T.23] 
FD. 
PO Bag 0:1 = 5.0601 520.518) (0.5 5 0.05)f0.086 59.99] og ey 
Ba Mat (0)°(1.06)(0.16)(0.0#7)(1.181) [0.107 ; 0.728] 


These are obtained by substituting the appropriate vehicle transfer 
functions from Tables B-II and B-IIT into Eqs. B~3 and B-l4, respectively. 
For a range of 15,000 ft (approximately at the threshold) the lateral 


flight director transfer function becomes 


2 iti edcich Rosca Ene uu Ae lat se Nee (B-7) 


PD, 0.1 x 3.06(1.32)(0.071) [0.8 3 0.186] [0.07 ; 0.59] 
Sa, (0)*(1.06)(0.16)(0.047)(1.18) [0.107 ; 0.728] 


Comparing Eqs. B-6 and B-7 shows that as range decreases the low frequency 
gain increases. This is a desirable feature since lateral errors will be 


smaller for the same crossover frequency. 


The transfer functions include the yehicle dynamics, and a closed-loop 
transient response to elevator or lateral offset will check the dominant 
modes of the controlled element. This. check can be demonstrated by feeding 
the flight director. output back to the control surface with unity gain as 


shown below: 


© command 


FDp 


€LOC command 


FD, 
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Figure B- is the closed-loop longitudinal response to a 5° elevator 
step. The points overplotted on the analog output represent the theoretical 
response from the linear transfer function. The dominant mode is the closed- 
loop phugoid/flight director complex pair, Qy — Op: 

Figure B-5 is the closed-loop lateral response to a step lateral offset 
of 250 ft. The closed-loop dutch roll is apparent in the aileron response, 
The common closed-loop roli~spiral coupled pair is dominant in the heading 
response and the low frequency is dominated by the flight director camplex 


zero pair. 
LATERAL AUTOPILOT 


A lateral autopilot was used to simulate human pilot control when the 
test subjects were flying the split-axis (longitudinal only) Configuration B. 
The result was a describing function “analog pilot" which looked like a 
low gain autopilot. 


The analog pilot output was 


53 =~ Yp, (Epo + Soy + KpyRez.og) (B-8) 


(T, s+1) (-1ts/2+1) 
where Yp, = (eri Cis/aety (B-9) 


The parameter values used were 


s 
: 


» << Kp, X RANGE = 28.4 
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Figure B-5. 


Be9b 


= .6 
Tho ~ sec 
T = .1 sec 
Tp 
tT = .59 sec 
R = 45,000 ft 


Note that the human pilot's reference to lateral displacement is through 
the Localizer bar, an angular measurement which must be divided by range 


to obtain linear. displacement. 


INSTRUMENTATION 


The cockpit instrumentation layout is shown in Fig. B-6. The angle of 
attack and sideslip indicators were not operational. A 1/2 scale detail drawing 
of the basic six instruments is given in the main text. The scaling and 
graduations of all the instruments can be obtained from that figure, except 


for the localizer, glide slope, and flight directors. These were: 


Localizer: +1 dot = +1° ETOC 
Glide slope: +1 dot = +0.2° Eqs 
Flight director, pitch: £6 rad 9 scale = +1FD,, units 
Flight director, roll: +0.1 rad mp scale = <1FD,. units 


The flight director was mechanically stopped at about £25° pitch and about 
fo) 
+5° roll. 


Frequency response measurements were made for all the cockpit instrumenta- 
tion. This was done using a photo cell and calculating the phase shift fram 
the zero axis crossings. Amplitude ratios were taken subjectively by the 
experimenter. Figures B-7—B-9 present these results. Attempts to fit the 
phase angle points with second-order systems are shown by the dotted lines. 
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Figure B- 6, 


Cockpit Instrument Layout 
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(a) Pitch Angle Instrument Frequency Response 
Figure B-7. Primary Longitudinal Instruments 
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Figure B-7 (Continued) 
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(c) Longitudinal Flight Director Instrument Frequency Response 
Figure B-7 (Concluded) 
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(a) Bank Angle Instrument Frequency Response 
Figure B-8. Primary Lateral Instruments 
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(b) Localizer Instrument Frequency Response 


Figure B-8 (Continued) 
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Figure B-9. Peripheral Longitudinal Instruments 
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Figure B-9 (Continued) 
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(c) Airspeed Instrument Frequency Response 
Figure B-~9 (Concluded) 
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MANIPULATOR PROPERTIES 


Static force-displacement data was taken on the simulator elevator 
and aileron systems. These are presented in Figs. B-10 and B-11, 
respectively. The large hysteresis in the rudder system precluded 
any measurements. The rudder was subsequently disconnected (electri- 
cally) from the simulation during the test program. Although dynamic 
responses were not taken, a measure of the system's frequency and damping 


may be estimated from Fig. Bei2 for releases from a given displacement. 


The throttle system was mechanized such that approximately 6 in. of 


throttle movement from the full aft stops represented 100 percent power. 
Individual throttle settings could be varied, but no moments were computed. 


A 1 sec time delay was mechanized to represent spool-up time. 
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Figure B-10. Elevator Control Force Characteristics 
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Figure B-12, Control Response from a Displacement Release 
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APPENDIX € 
FORCING FUNCTIONS AND TRACERS 


The multiloop system studied is shown in block diagram form in Fig. C-1. 


The dominant feedback loops include pitch attitude, 9, deviation from glide 


slope, €gg, rate of climb, h, and airspeed, U. Glide slope command, EGS? 


and pitch attitude command, @,, forcing functions were used, generated with 
interleaved sums of sine waves. Tracer frequencies were added to other 
signals to detect additional pilot response. These methods allow several 
display and control variables to be correlated and the dominant closed-loop 


responses to be measured. 
FORCING FUNCTIONS 


Command inputs in pitch angle and glide slope deviation provided 
realism and aided measurements, They were shaped to represent a vertical 


gust disturbance and glide slope beam noise, respectively. 


Gusts actually enter the system through the airframe, not as commands, 
but a true gust input results in poor measurements. The signal/noise ratio 
is low at high frequency, and the forcing function shape (an important task 
variable) is determined by the closed-loop pilot/vehicle properties. This 
attenuation is shown by Fig. C-2, a plot of the predicted closed-loop /We 
response. An equivalent pitch attitude command was used to avoid these 


measurement problems. 


The forcing function bandwidths must be well below the anticipated 
crossover frequency to avoid regression in pilot crossover frequency, yet 
still have significant power in the mid-frequency region for good measure- 
ments. Large signal amplitudes are desirable, yet the signals should be 


fairly small for realism in an ILS approach situation. 


The power spectrum of the pitch attitude forcing function is shown by 


the solid line in Fig. C-3.* The circles indicate the sine wave components 


*This input tape was made on 14 February 1969 and used on subsequent runs. 
The inputs used prior to this date and during the shakedown runs had slightly 
higher bandwidths and different shelf amplitudes. 
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Figure C-1. Pilot/Vehicle System with Forcing Functions and Tracers 


Amplitude Ratio (dB) 


0.02 O.! w{rad/sec) 


Figure C-2. Amplitude Ratio of e/w, with 6 ~ 5d, 
and eqg —-~ 5, Loops Closéd 


used to generate the spectrum. The predicted pilot crossover frequency 
was 2 to 2.5 rad/sec. The effective forcing function bandwidth is about 
0.8 rad/sec. The high frequency "shelf" provides some measurement power 
at and beyond crossover. The input had an rms pitch deviation of about 
18°: equivalent to a vertical. gust with an rms amplitude of about 5 ft/sec. 


It was on input recorder channel 1.* This forcing function is roughly 


*The input recorder head configuration had channels 1, 3, 5, and 7 on 
head 1 and channels 2, , 6, and 8 on head 2. The heads were displaced 
from each other by 1 track width. 
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Figure C-3. Power Spectrum of Pitch Angle Forcing Function 


consistent with that used in Ref. 14, which had a bandwidth of 1 rad/sec 


and an rms of 8 ft/sec. 


The glide slope forcing function is shown in Fig. C-4. The circles 
represent the sine wave input components. The pilot crossover frequency 
predicted in this loop was approximately 0.5 rad/sec. The effective 
forcing function bandwidth is about 0.3 rad/sec with a second-order 
rolioff and —20 dB shelf. The relative amplitude was set to have an 
ms of 0.04° path angle, or about 0.2 dots of rms needle deflection. 

It was on input recorder channel 4. This forcing function is consistent 


with beam bend data of Ref. 20. 
TRACERS 


Tracer frequencies were added to the displayed signals on some of the 
remaining instruments. The tracers were single (in one case, two) sinusoids 


with their magnitudes adjusted to be barely perceptible to the pilot. The 


cu 
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Figure C-k. Power Spectrum of Glide Slope Forcing Function 


tracer properties are summarized in Table C-I. The selection considerations 
could not all be satisfied, primarily because of the limited number of 


nonharmonically related, low frequency sinusoids in a 100 sec run length. 
INFUL TAPE RECORDER 


The input tape recorder (Vetter Model A) was set up with all record 
channels “full on." The first 50 ft of tape was recorded with a grounded 
input in order to have a null reference for removing biases, The record 
and playback speeds were 7.5 ips. About 10 min of recording was made. 
With the Vetter playbacks full on, the output level in playback is one~half 
the input level when recorded. 


TR-170-4 C=5 


Localizer deviation, 
ELOCm 


Roll angle, On 


Rate of climb, Dp 


Forward velocity, 
Up 


TABLE C-I 


TRACER PROPERTIES 


SELECTION CONSIDERATION 


Low frequency, near the pilot/vehicle lateral 


deviation crossover frequency 


Mid-frequency, near pilot/vehicle crossover 
frequency in roll 


Mid~frequency, representative of a vertical 
gust disturbance 


Low or mid-frequency, near pilot/vehicle 
erossover frequency for airspeed control, 
or similar to a u-gust 


FREQUENCY 
(RAD /SEC ) 


AMPLITUDE | RECORDER 
(PEAK) | CHANNEL 


PRESENTATION TO THE PILOT 


A 100 sec sample of the forcing functions and tracers is shown in 
Fig. C-5. They went from the input recorder to a TR-48 analog computer 
for scaling. From there, the signals went to the instrument bay and then 
to the panel in the cockpit. The forcing functions and tracers were only 
present on the instrument display to the pilot, and did not drive the 
vehicle equations of motion directly. 

The longitudinal forcing functions drove the longitudinal flight 


director (as well as the basic instriments) when that configuration was 


used. The lateral tracers did not appear on the lateral flight director. 
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Figure C-5. Sample of Forcing Function and Tracers 
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APPENDIX D 
BACKGROUND OF PILOT SUBJECTS 


This appendix summarizes the background and qualifications of the 
four key pilots who participated in the test program. Three other subjects 
were used but their data have not been analyzed. The tables show their 
experience level, training background, and current status including air- 


craft and instrument panel configuration. 


The subjects are all subsonic jet transport pilots by profession. They 
vary in age and experience. Note that Pilot 2 has a general aviation (light 
plane), rather than military, background. Pilot 3 is the only subject with 
significant and current high performance (military) single-engine jet experi- 


ence. He is still active in the Marine Corps Reserve. 


CURRENT EQUIPMENT 


Aircraft: B-707 
Flight Director: Sperry 
Panel Configuration: 


*Glide slope and localizer 


HORIZON 


Aircraft: B-720B 
Flight Director: Collins FD-108 
Panel Configuration: 


HORIZON 


= 
ORoe 

Fane 
Ona EOnO 


HSI /GSD 


EXPERIENCE 


Pilot No. 1 Age: 50 
Position: Training Captain (PAA) 
Total Hours: 14,500 

Commercial Flight Experience: 


1,600 hrs jet (707, 720) 
10,800 hrs recip. (DC-3, DG-4, Convair 340, 240) 


Military Flight Experience: 


1,300 hrs recip. (B+25, C-121, pesto") 
300 hrs fighter (P-51) 


Private Flight Experience: None 

Number of ILS Approaches: 500 

Hours Last 6 Months: 230 

Number of Category II Landings: 55 

Last Category II Landing Within: 1 week 


Pilot No. 2 Age: 26 
Position: Copilot (Western) 
Total Hours: 3,400 

Commercial Flight Experience: 


1,200 hrs jet (707) 
145 hrs simulator 


Military Flight Experience: None 
Private Flight Experience: 

2,500 hrs (Cessna 120, 310) 
Hours Last 6 Months: 200 
Number of ILS Approaches: 100 (est.) 
Last Category II Landing Within: None 


CURRENT EQUIPMENT EXPERIENCE 


Aircraft: B-707 and A-4 Pilot No. 3 Age: 29 

Flight Director: Bendix Piet s. . 

Panel Configuration: Position: Copilot (TWA) 
Total Hours: 4,050 


HORIZON 

eS Commercial Flight Experience: 
2,000 hrs jet (B-707) 
ey ©) Ree. 
ss a Military Flight Experience: 


1,750 hrs (A-4, ete.) 
Private Flight Experience: 


© 300 hrs 
Hours Last 6 Months: 450 


Keaed Number of Category II Landings: None 


saliae slope and localizer Last Category II Landing Within: 


Aircraft: CV-990-A Pilot No, } Age: Approximately 50 
Flight Director: Pee . 
Panel Configuration: Position: Captain (Northrop Test Pilot) 
Total Hours: 11,500 
Commercial Flight Experience: 


3,100 jet (CV-990) 
7,000 recip. 


~ATT/FD Military Flight Experience: 
800 recip. (B~36) 


i Sy 25 fighter (P-51) 
Private Flight Experience: None 
Ke af Hours Last 6 Months: 200 


(we) a Number of Category II Landings: Unknown 
Last Category II Landing Within: 1 Month 


APPENDIX E 
DETAILED EFR RESULTS 


This appendix presents detailed scanning traffic results, discussed 
in Section IIIT. Table E-I presents the individual results for the 31 runs 
analyzed in detail. Table E-IT are the one-way link transition matrices 
for the average of each of the subject /configuration eells. Each matrix 
cell gives the fraction of the total number of transitions which went from 


the row (instrument) to the column (instrument). 


Dwell time histograms for the 10 subject /configuration cells on each 
of the 5 instruments are presented in Figs. E-1 through E-5. There were 


no dwells on instrument }. 
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TABLE E-IT 
ONE-WAY LINK TRANSITION MATRICES 


CONFIGURATION ONE-WAY LINK MATRICES* 
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*Format: 


Note: Transition from i to i indicates an 
interruption due to a blink. 
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Figure E~2, 


Percent of Fixations 
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Dwell Time Histograms for Instrument 2, ATI/FD 
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Figure E-3. 
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Dwell Time Histograms for Instrument 3, PALT 
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Figure E-i, Dwell Time Histograms for Instrument 5, HSI/GSD 
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